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Abstract 

We have discussed the dynamics of Langevin model subjected to colored noise, 
by using the functional-integral method (FIM) combined with equations of motion 
for mean and variance of the state variable. Two sets of colored noise have been 
investigated: (a) one additive and one multiplicative colored noise, and (b) one 
additive and two multiplicative colored noise. The case (b) is examined with the 
relevance to a recent controversy on the stationary subthreshold voltage distribu- 
tion of an integrate-and-fire model including stochastic excitatory and inhibitory 
synapses and a noisy input. We have studied the stationary probability distribution 
and dynamical responses to time-dependent (pulse and sinusoidal) inputs of the 
linear Langevin model. Model calculations have shown that results of the FIM are 
in good agreement with those of direct simulations (DSs). A comparison is made 
among various approximate analytic solutions such as the universal colored noise 
approximation (UCNA). It has been pointed out that dynamical responses to pulse 
and sinusoidal inputs calculated by the UCNA are rather different from those of DS 
and the FIM, although they yield the same stationary distribution. 
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1 Introduction 



Nonlinear stochastic dynamics of physical, chemical, biological and economical systems 
has been extensively studied (for a recent review, see Ref. pQ). In most theoretical studies, 
Gaussian white noise is employed as random driving force because of its mathematical 
simplicity. The white-noise approximation is appropriate to systems in which the time 
scale characterizing the relaxation of the noise is much shorter than the characteristic 
time scale of the system. There has been a growing interest in theoretical study of 
nonlinear dynamical systems subjected to colored noise with the finite correlation time 
(for a review on colored noise, see Ref. [2j: related references therein). It has been realized 
that colored noise gives rise to new intriguing effects such as the reentrant phenomenon 
in a noise-induced transition |3] and a resonant activation in bistable systems pi] . 

The original model for a system driven by colored noise is expressed by non-Markovian 
stochastic differential equation. This problem may be transformed to a Markovian one, by 
extending the number of relevant variables and including an additional differential equa- 
tion describing the Orstein-Uhlenbeck (OU) process. It is difficult to analytically solve the 
Langevin model subjected to colored noise. For its analytical study, two approaches have 
been adopted: (1) to construct the multi-dimensional Fokker-Planck equation (FPE) for 
the multivariate probability distribution, and (2) to derive the effective one-dimensional 
FPE equation. The presence of multi- variables in the approach (1) makes a calculation of 
even the stationary distribution much difficult. In a recent study on the Langevin model 
subjected to additive (non-Gaussian) colored noise [5], we employed the approach (1), 
analyzing the multivariate FPE with the use of the second-order moment method. A typ- 
ical example of the approach (2) is the universal colored noise approximation (UCNA) [6], 
which interpolates between the limits of zero and infinite relaxation times, and which has 
been widely adopted for a study of colored noise [2]. Another example of the approach (2) 
is the path-integral and functional- integral methods [7]- [12] obtaining the effective FPE, 
with which stationary properties such as the non-Gaussian stationary distribution have 
been studied [2J. 

Theoretical study on the Langevin model driven by colored noise has been mostly made 
for its stationary properties such as the stationary probability distribution and the phase 
diagram of noise-induced transition [2]. As far as we are aware of, little theoretical study 
has been reported on dynamical properties such as the response to time-dependent inputs. 
Refs. [T51 [T3] have discussed the filtering effect, in which the high-frequency response of 
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the system is shown to be improved by colored noise. The purpose of the present paper 
is to extend the functional-integral method (FIM) such that we may discuss dynamical 
properties of the Langevin model subjected to colored noise. We consider, in this paper, 
two sets of colored noise: (a) one additive and one multiplicative colored noise, and (b) 
one additive and two multiplicative colored noise. The case (b) is included to clarify, 
to some extent, a recent controversy on the subthreshold voltage distribution of a leaky 
integrate-and-fire model including conductance-based stochastic excitatory and inhibitory 
synapses as well as noisy inputs [T5]-[T8]. 

The paper is organized as follows. The FIM is applied to the above-mentioned cases (a) 
and (b) in Sees. 2 and 3, respectively, where the stationary distribution and the response 
to time- dependent inputs are studied. In Sec. 4, we will discuss the recent controversy 
on the subthreshold voltage distribution of a leaky integrate-and-fire model [E)]-[IB]- A 
comparison is made among results of some approximate analytical theories such as the 
UCNA [2], [6] . The final Sec. 5 is devoted to conclusion. 

2 Langevin model subjected to one additive and one 
multiplicative colored noise 

2.1 Effective Langevin equation 

We have considered the Langevin model subjected to additive and multiplicative colored 
noise given by 

^ = F(x)+ Vo (t) + G(x)rj 1 (t), (1) 

with 

u ''im\' J l 'lm , 

—t— = 1 UW) (m = and l) (2) 

where F(x) and G(x) denote arbitrary functions of x: r] (t) and rjx (t) stand for additive 
and multiplicative noise, respectively: r m and D m express the relaxation times and the 
strengths of colored noise for additive (m = 0) and multiplicative noise (m — 1): rj m (t) 
express independent zero-mean Gaussian white noise with correlations given by 

(£m(*)£n(0> = S mn 8(t-t'). (3) 

The distribution and correlation of r] m are given by 



2D m 



P(Vm) oc expf-^^-j&J , (4) 
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Cmn(t,t') = (r] m (t)r} n (*')) = 5 mn (— ) exp ( — - — — J . (5) 

By applying the FIM to the Langevin model given by Eqs. (1) and (2), we obtain the 
effective FPE given by [11] (details being given in the Appendix) 

%-p(x,t) = -^-F(x)p(x,t) + D -^-p(x,t) + D 1 ^-G(x)^-G(x)p{x,t), (6) 
ot ox ox z ox ox 

from which the effective Langevin model is derived as 

dx 



ijf F(x) + V2A)fo(*) + \/2D 1 G(x)Z 1 (t), (7) 
with 

F = F, (8) 

6 " - JT^iFjy (9 > 

Dl = [l- Tl ({F')-{FG'/G))Y (10) 

Here F' = dF/dx and G' = dG/dx, and the bracket (•) expresses the average over p(x,t) 
to be discussed shorty [Eq. (11)]. It is noted that we will temporally evaluated (F') etc. 
in order to discuss dynamics of the system, while they are conventionally evaluated for 
the stationary value as F'(x s ) etc. with x s = (x(t = oo)) [7] [TT]. 

2.2 Equations of motion for mean and variance 

With the use of the effective FPE given by Eq. (7), an equation of motion for the average 
of Q{x): 

(Q) = f Q(x) P (x,t)dx, (li) 



is given by [19] 

d{Q) 
dt 

which yields (for Q = x,x 2 ) 

d(x) 

dt 
d(x 2 ) 

dt 



(Q'F) + D (Q") + b x {{Q'G)'G), (12) 



(F)+D 1 (G'G} 1 (13) 
2 (xF) + 2D + 2Di (G 2 + xG'G) . (14) 



4 



Mean (/i) and variance (7) are denned by 



\i = (x), (15) 
7 = ( x 2 ) - ( x ) 2 . (16) 

Expanding Eqs. (13) and (14) around the mean value of /i, and retaining up to the second 
order of ((<5xj) 2 ), we get equations of motion for /i and 7 expressed by [19] 

4? = 7o + /27 + ^'i[5 , o5 , i + 3(5'ifi'2 + 5 , o5 , 3)7], (17) 
^ = 2f ll + 4D ll (g 2 l + 2g g 2 ) + 2D l g 2 + 2D , (18) 

where f e = (l/£\)d e F(/i)/dx e and g t = (l/£!)<9 £ G(/i)/&r £ . It is noted that D and D 1 in 
Eqs. (17) and (18) are given by Eqs. (9) and (10), respectively. 

In the case of F(x) = —As + / and G(x) = x where A and / denote the relaxation 
rate and an input, respectively, the FIM yields equations of motion for /x and 7 given by 



~dt 



-\H + D lfi + I, (19) 



5 = -2A7 + 4D l7 + 2Di// 2 + 2D , (20) 



dt 
with 

D ° = TTrky (21) 

* = TOM < 22 > 

We have to solve Eqs. (19)-(22) for /1, 7, Z) an d -Di m a self-consistent way. 
Stationary values of /1 and 7 are implicitly given by 

= jdnTY (23) 

7, = + (24) 

(A-2Di) V ; 

with D and Z?i given by Eqs. (21) and (22), respectively, with fi = fi s . Equations 

(23) and (24) show that /i s and 7 S diverge for D\ > A and D\ > A/2, respectively. The 
divergence of moments is common in systems subjected to multiplicative noise, because 

its stationary distribution has a long-tail power-law structure [IH]-[2T]- From Eqs. (22) 
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and (23), we get 



Dx 



[i + n(A -Dx)} 

1 + An) - J(l + Xrx) 2 -AtxDx 



which yields 



Dx 



2tx 
Dx 



(25) 
(26) 



1 + An 

Dx 

(l + An) 



l + 



TxDx 



2 - 1 , 1 ; , + 



1 + An) 2 (1 + An) 4 
Df p . for rxDx/(l + An) 2 < 1 



(27) 



Equation (27) implies that the approximation of is valid both for (i) n (1/ A, 1/-Di) 

and (ii) n > (1/A, D1/A 2 ). 

2.3 Stationary distribution 

From the effective FPE given by Eq. (7), we get the stationary distribution p(x) given by 

r 



\np{x) 



^ ) ln[£> + Dx G(x) 2 } + Z{x) 



with 



Z(x) 



F(x) 



dx. 



(2f 



(29) 



[D + DiG(x) 2 } 

Because of the presence of multiplicative noise, the stationary distribution generally has 
non-Gaussian power-law structure |19j-[21j. 

In the white-noise limit (r m = 0), the stationary distribution for the Langevin equation 



given by Eq. (1) with r\ m = \/2D m is expressed by Eqs. (28) and (29) with D m = D m 
in the Stratonovich representation. Then the stationary distribution for colored noise is 
expressed by 



p(x;D ,D 1 ,T ,T 1 ] 



p(x; D , Dx, 0, 0) = p wn (x; D , Dx), 



(30) 



where p wn (x; D ,Di) expresses the stationary distribution for white noise. 
In the case of F(x) = —Xx + I and G(x) = x, we get 



p(x) oc ( J D + J Di^ 2 ) _(A/2 ^ 1+1/2) exp[r(x)], 



with 



Y(x) 



D D ± 



tan 



-1 













-=—x 




Do J 



(31) 



(32) 



D = 



Do 



(33) 



D 1 = 



(1 + Aro)' 
D l 



(34) 



[l + fa//^)]' 



where fi s expresses the stationary value of /i [Eq. (23) ]. 

2.4 Model calculations 

2.4.1 Stationary properties 

In order to demonstrate the feasibility of our analytical theory, we have performed model 
calculations. Direct simulations (DSs) for Eqs. (1) and (2) have been performed by using 
the fourth-order Runge-Kutta method for period of 1000 with a time mesh of 0.01. Results 
of DSs are the average over hundred thousands trials otherwise noticed. All quantities 
are dimensionless. 

The Ti dependence of the ratio of D\/ Di is depicted in Fig.l, where results calculated 
by the FIM and the approximation (APP) given by Eq. (27) are shown by solid and dashed 
curves, respectively, for A = 1.0, Dq = 0.01, D\ = 0.2 and To = 0.01. D\ calculated by 
the APP is in good agreement with that by the FIM, and the effective noise strength is 
decreased with increasing t\. The difference between D\jD\ of the FIM and APP, plotted 
by the chain curve, is zero at T\ — with a maximum at t\ ~ 0.5, and decreased at larger 
Ti (> 1). The APP is fairly good for small T\ and large t±, as discussed after Eq. (27). 

Figure 2 (a)-(f) show the stationary distribution p(x) calculated by the FIM (solid 
curves), DS (dashed curves), with the APP (chain curves) and in the white-noise limit 
(WN: double-chain curves) when T\ is changed for fixed values of A = 1.0, D = 0.01, 
Di = 0.2 and r = 0.01: (a), (c) and (e) in normal scale, and (b), (d) and (f) in log 
scale. Calculations show that with increasing t±, p(x) becomes narrower, deviating from 
results of WN. Results of the FIM and APP are in fairly good agreement with those of 
DS: results of the APP is indistinguishable from those of the FIM. Figures 2(b), (d) and 
(f) plotting p(x) in log scale show that results of the FIM and APP are in fairly good 
agreement with that of DS up to the order of 10~ 2 for T\ — 1.0 and of 10 -4 for T\ = 5.0. 

2.4.2 Dynamical properties 

We have investigated the response to an applied pulse input given by 



I(t) = AQ(t - t h ) Q(t e -t) + B, 



(35) 
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where A = 0.5, B = 0.1, tj, = 100 and t e = 200, and Q(t) is the Heaviside function. Time 
courses of fi(t) and 7(t) are shown in Fig. 3(a)-(f), where T\ is changed for fixed values 
of A = 1.0, Dq = 0.01, Di = 0.2 and r = 0.01. With increasing t±, ji{t) and ■jit) induced 
by an applied pulse at t b < t < t e are decreased. This is because they are given by 

KQ = {A + B) , (36) 

^' (A - Di) 1 ; 

7 (0 = Do , + {A + B)2 °\ , lort b <t<t e (37) 

RJ (X-2D 1 ) (A-2 J D 1 )(A- J D 1 ) 2 ' 1 ; 

where D\ is decreased with increasing t\ as Fig. 1 shows. The results of the FIM and 
APP are again in good agreement with that of the DS: the FIM yields slightly better 
results than the APP as shown in Figs. 3(b) and 3(f). 

Next we study the response to a sinusoidal input given by 

I{t)=Csmu;t, (38) 

where C = 0.5, uo = 2ir/T p and T p = 100. Figures 4(a), (c) and (f) show time courses 
of /i(t), and Figs. 4(b), (d) and (f) those of j(t) when T\ is changed for fixed values of 
A = 1.0, -D = 0.01, Di = 0.2 and r = 0.01. With increasing r±, the magnitude of fj,(t) is 
decreased. This is understood from an analysis with the use of Eq. (19), which yields 

C 

/i(t) = = sin(cut - 0), (39) 

with 

^ tan "fe)' (40) 

Equation (39) shows that with increasing uj {i.e. decreasing T p ), the magnitude of //(£) is 
decreased, representing a character of the low-pass filter. 

3 Langevin model subjected to one additive and two 
multiplicative colored noise 

3.1 Effective Langevin equation 

We have assumed the Langevin model subjected to one additive (770) and two multiplica- 
tive colored noise (771, i] 2 ), as given by 

(1 T 

— = F(x) + r)o(t) + G 1 (x)r )l (t) + G 2 (x)r) 2 (t), (41) 



with 

^^ = --Vm + ^Ut), (m = 0,l,2) (42) 

where F(x), G\(x) and G 2 (x) express arbitrary functions of x, and £ m are independent 
zero-mean white noise with correaltion: 

(U(t)Ut')) = S mn S(t-t'). (43) 

Applying the FIM [H] to the model under consideration, we get the effective FPE 
given by (details being given in the Appendix): 

d d ~ ~ d 2 

— p(x,t) = -—F(x)p(x,t)+D —p(x,t) 

+ D 1 -^-G 1 (x)^-G 1 (x)p(x,t) + D 2 ^-G 2 (x)^-G 2 (x)p{x,t), (44) 
ox ox ox ox 

from which we get the effective Langevin equation: 

^ = F(x) + y/2& Ut) + ^iGiix) &(t) + yf2D 2 G 2 (x) (45) 

with 

D " = <r^k) B < 46 > 

A » = [i-r„(( f -)-> G ;,/ Gm ))] - < m = 1 < 2 > (47 > 

where F' = dF/dx and G' m = dG m /dx, and the bracket (•) stands for the average over 
p(x,t): 

(Q(x)) = J Q(x) p{x,t) dx. (48) 
3.2 Equations of motion for mean and variance 

By using the effective FPE given by Eq. (45), we can obtain equations of motion for mean 
(/i) and variance (7) defined by 

fi = (x), (49) 
7 = ( x 2 ) - (x) 2 . (50) 

When F(x) and G m (x) are given by 

F(x) = -Ax + I, (51) 
G m = a m (x-e m ), (m = l,2) (52) 



where A is the relaxation rate, I an input, and a m and e m constants, we get equations of 
motion for fi and 7 given by [19] 



^ = -\ii + I + Di{ t i-e 1 ) + D 2 (n-e 2 ), (53) 
^ = -2X 1 + A(D 1 + D 2 ) 1 + 2D 2 (fi-e 1 ) 2 + 2D 2 ( f i-e 2 ) 2 + 2D , (54) 



with 



* = (55) 

£ m = m ? X %7Y7? VT" (form =1,2) (56) 

[1 + r m (-Ae m + /)/ (/i - e m )J 

It is necessary to self-consistently solve Eqs. (53)-(56) for /x, 7, D , -Di and D 2 . 
Stationary values of \x and 7 are implicitly given by 

M. - U /; ^ S . (57) 

(A -A -£> 2 ) ' 1 J 

[ j P + D 1 (^-e 1 ) 2 + D 2 (/x s -e 2 ) 2 ] 

[A — 2(1?! + D 2 )\ ' 1 1 

with Z) m (m = 0,1,2) given by Eqs. (55) and (56) with \i = fi s . Equations (57) and 
(58) show that fj, s and 7,, diverge for (D\ + D 2 ) > A and (D\ + D 2 ) > A/2, respectively. 
Equation (27) suggests that the approximation given by 

An ^ tz ^7 : = ^ PP , for r m D m /(l + Ar m ) 2 < 1 (m = 1, 2) (59) 

may be valid both for small r m and large r m , as will be numerically shown in Fig. 5 [22] . 

3.3 Stationary distribution 

From the effective FPE of Eq. (45), we get the stationary distribution p(x) given by pj5] 
lnp(x) = -(^j\n[D + D 1 G 2 1 (x)+D 2 G 2 2 (x)] + Z(x), (60) 

with 

Z(x) = I -~ = f (x) - dx. (61) 

1 J J [D + DiG\(x) + D 2 G 2 2 (x)} 1 ' 

In the white- noise limit (r m = 0), the stationary distribution of the Langevin model 
given by Eq. (41) with r\ m = y/2D m (m = 0, 1, 2), is expressed by [T9~]-[2~T] 



lnp(x) = Z(x) - []-)\n[D + D 1 G 2 1 (x) + D 1 G 2 1 (x)}, (62) 
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with 

z{x)= ljD^D^hmm dx ' (63) 

in the Stratonovich representation. It agrees with the distribution given by Eqs. (60) and 
(61) with D m = D m . 

When F(x) and G m (x) are given by Eqs. (51) and (52), we get 

p(v) oc (d 2 v 2 + d 1 v + d )-( x/2d2+1/2) exp[Y(v)}, (64) 

with 



x d 2 ^4d d 2 -d\j \ yj Ad Q d 2 - d\j 



where 



1)0 = arky <«> 

Dm = f— 7 r jP T n/ , rr, (form = 1,2) (67) 

[1 + r m (-Xe m + I)/{Hs - e m )\ 

d = D + b x a\e\ + D 2 a\e\ (68) 

di = -2pia?ei + £> 2 ^e 2 ) (69) 

rf 2 = D ia l + D ia j, (70) 

/i s denoting the stationary value [Eqs. (57) and (58)]. 

It is easy to see that for additive noise only (Di = D 2 = 0), the distribution becomes 
the Gaussian given by 



p(x) oc exp 



A / / 



x — — 



(71) 



2d V A, 

When multiplicative noise is included, p(x) becomes the non-Gaussian distribution with 
power-law tails. 

3.4 Model calculations 
3.4.1 Stationary properties 

Figure 5 shows D m /D m (m = 1, 2) as a function of T\ calculated by the FIM for m — 1 
(solid curve) and m = 2 (dashed curve) with fixed values of r 2 jr\ = 10, A = 1.0, D = 0.01, 
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D x = 0.1, D 2 = 0.2 and r = 0.01. With increasing n (= r 2 /10), D l /D 1 and D 2 /D 2 
are gradually decreased. In order to examine the validity of the approximation (APP) 
given by D^ l pp in Eq. (59), we show differences between D m /D m of the FIM and APP 
for m = 1 (chain curve) and m = 2 (double-chain curve). Both the differences start from 
zero at T\ = 0, have maxima at T\ ~ 0.5 — 1, and are decreased at larger t\. This shows 
that the APP is valid both for small T\ and large Tx, whose behavior is similar to that 
shown in Fig. 1. 

Figures 6(a)-(f) show the stationary distribution p(x) calculated by the FIM (solid 
curves), DS (dashed curves), the APP (chain curves) and in the white- noise limit (double 
chain curves), when T\ and r 2 are changed with a fixed ratio of t 2 /t\ = 10, and r = 0.01, 
/ = 0.5, A = 1.0, A) = 0.01, D x = 0.1 and D 2 = 0.2: Fig. 6(a), (c) and (e) are plotted in 
normal scale while Fig. 6(b), (d) and (f) in log scale. With increasing the relaxation time 
for multiplicative colored noise, the width of p(x) is decreased and its profile approaches 
the Gaussian. 

3.4.2 Dynamical properties 

Responses of /z(t) to a pulse input given by Eq. (35) are shown in Figs. 7(a), (c) and (e) 
by changing the relaxation time with a fixed value of t 2 /t\ = 10. They are calculated by 
the FIM (solid curves), DS (dashed curves), the APP (chain curves) and in the white- 
noise limit (WN: double-chain curves). Similarly the response of ^(t) are plotted in Fig. 
7(b), (d) and (f). With increasing the relaxation time of colored noise, the effective noise 
strength is decreased, and then the values of /z(t) and j(t) at 100 < t < 200 is decreased, 
as shown by Eqs. (39) and (40). Figures 7(d) and 7(f) show that the FIM yield slightly 
better results than the APP. The general trend of the effect of the relaxation time on 
p(x), nit) and ^(t) shown in Figs. 6 and 7 is the same as that shown in Figs. 2 and 3. 

4 Discussion 

4.1 A controversy on the subthreshold voltage distribution 

In recent years, a controversy has been made on the subthreshold voltage distribution of a 
leaky integrate- and- fire model [15]- [18]. The adopted model includes conductance-based 
stochastic excitatory and inhibitory synapses as well as noisy inputs, as given by [T5]-[18j 

C % = -9L(v-E L )--I syn (t), (72) 
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with 



hynit) = g e (v-E e )+g i (v-E i )-I I (t). (73) 

Here C denotes the membrane capacitance, a the membrane area, gi and El the leak 
conductance and reversal potential, and g e> i and E e ^ are the noisy conductances and 
reversal potentials of excitatory (e) and inhibitory i synapses, respectively. Stochastic g e>i 
and noisy additional input Ij{t) are assumed to be described by the OU process given by 



^ = --(m-9») + \—W), (75) 

at Ti V Ti 



§ = -i( Wo ) + ^L Wt ), (-6) 

where £ e et el. are independent zero-mean white noise with correlation: 

(Ut)L'(t')) = 8 KK ,5(t-t'). (« = J,e,i) (77) 

In the first paper of Rudolph and Destexhe (RD1) [15], they derived an expression for 
the stationary distribution function of the system described by Eqs. (72)- (76). In their 
second paper (RD2) [16], they modified their expression to cover a larger parameter 
regime. Lindner and Longtin [17] criticized that the result of RD1 does not reconcile the 
result of white-noise limit and that the extended expression of RD2 does not solve the 
colored- noise problem though it is much better than that of RD1. In the third paper 
of Rudolph and Destexhe (RD3) [IB], they claimed that the result of RD2 is the best 
from a comparison among various approximate analytic expressions for the stationary 
distribution. It has been controversy which of approximate analytic expressions having 
been proposed so far may best explain the result of DSs. 

It is worthwhile to apply our method mentioned in Sec. 3 to the system given by Eq. 
(72)-(76), which are rewritten as 

dv 



u F(v) + G lVl (t) + G e (v) Ve (t) + G t (v) Vi (t), (78 
at 



with 



a. = Vk+ (« = e,«,ij (79) 

at t k t k 
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where 



F(v) = -^g L (v - E m ) - -±-[g e0 (v - E e ) + g i0 (v - Et) - I ], (80) 

G > = h < 81 > 

GeM = -^(v-E eii ), (82) 

Dl, e ,i = Tl,e,i^ 2 I, e ,i- (83) 

By using Eqs. (64)- (70), we get the stationary distribution p(v ) given by 

p(v) oc (d 2 v 2 + d lV + d )~^ 2d2+1 ^ exp[Y»], (84) 



with 



, ■>< ■<,(!■> ■ Ac/i \ | / 2d 2 v + d 1 , 

= I / tan / ) , (85) 

k d 2 ^d d 2 -d\j \^Ad d 2 -df j 



where 



A = ^9l + -^{g e o + 9io), (86) 

c = ^gLE m + ^-(g e0 E e + g i0 Ei + I I0 ), (87) 

d ° = -^(Dj + D^ + D.Ef), (88) 

di = --^(DeE. + DiEi), (89) 

d * = ^(5 e + A). (90) 
With the use of Eqs. (57) and (58), D K in Eqs. (88)-(90) are expressed by 

b < = offer (91) 

n = £l (qo) 

[l + T e (-\E e + co)/(jM.-E e )Y 1 1 

Di 

Di = [l + Tii-XEi + ^/ifis-Ei)]' (93) 
Here fi s denotes the stationary value of v which is determined by the self-consistent 

equations for /i s , j s , D e and A [as Eqs. (57) and (58)], though their explicit expressions 
are not necessary for our discussion. 

In the limit of small relaxation times, Eqs. (92) and (93) yield 

b - ~ n t\ V (forr eJ D e «l) (94) 
(1 + Ar e ) 

A ^ tz °\ r - (forr,A<l) (95) 
14 



This is nothing but the approximation introduced in RD2 [16]. 

In the white- noise limit (i7 e,j = 0), the stationary distribution of the model given by 
Eq. (78) with rj K = s/2D~ K (« = J, e, i) is given by p2]-[2l] 



with 



]n/v„(>: D,. D r . D,) = Z(c) ( ^ ) ln^Gf + D e G 2 e {v) + AG?(u)]. (M) 



^ = / M + + (97) 

in the Stratonovich representation. We note that our stationary distribution given by 
Eqs. (84)-(90) is consistent in the white-noise limit, and that the distribution for colored 
noise, is expressed by 

p{ v 'i Dj, D e , Di, ti, r e , Tj) = PunfaDitDaDi), (98) 

where Dj, D e and Di given by Eqs. (91)-(93) take account of effects of relaxation times. 
If we adopt approximate expressions for D e and Di given by Eqs. (94) and (95), we get 

( n n n ^ I Dl D * ^ 

p(v; Di, D e , D h r 7 , r e , = p wn 



v ' (1 + Arj)' (1 + Ar e )' (l + Xn))' 

(for r e D e < 1 and T t D, < 1) (99) 

Lindner and Longtin have pointed out that the first solution of RD1 is given by [17] 

p RD1 (v;D I ,D e ,D i ,T I ,T e ,T i ) = Puwta-^-yj-y)- ( 10 °) 

With the use of the Fourier transform of stochastic equations, Rudolph and Destexhe 
have obtained in RD2 [16], the stationary distribution with Dj — given by 

( D e D, t \ . 

Prd2{v; Dj = 0, D e , D it tj, r e , r<) = p wn f ; Dj = 0, 7- - r , 7- - r ■ (101) 

\ (l + Ar e J (1 + ATijy 

It is noted that Eq. (101) coincides with Eq. (99) for Dj = 0. Model calculations in 
Sec. 3.4 have shown that the approximation given by Eq. (59) yields a good result. This 
is true also for the approximation given by Eqs. (94) and (95). This explains to some 
extent the reason why the approximation adopted in RD2 provides us with good results, 
as claimed in RD3 |18|. 
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4.2 A comparison with previous approximations 

We have discussed, in Sec. 2, the dynamics of the Langevin model subjected to colored 
model, by using the FIM. It is interesting to make a comparison among several approxi- 
mate, analytical methods having been proposed so far for the Langevin model subjected 
to colored noise: 

^ = F(x)+G(x)r ]l (t), (102) 

where rji (t) is described by the OU process of Eq. (2). 

First we apply the UCNA to Eq. (102) [21 [6]. Taking the derivative of Eq.(102) with 
respect to t, eliminating the variable 771 with the use of Eq. (2), and neglecting the x term 
after the UCNA, we get the effective Langevin equation given by 

(IT ~ ~ 

- = F(x) + D 1 G(x)^(t), (103) 



with 



F u = ^ (104) 

[l- Tl (F'-FG'/G)Y { } 

D ' = [l- Tl (F'-FG'/G)r (105) 
The stationary distribution is given by 

p{x) oc exp[-lnG(z)+y(x)], (106) 

with 



Y(x) ^ ^JJiw dx - (107) 



In the case of F(x) = —Xx and G(x) = x, we get 

p{x) OC ^-[Aa+ArOM+l]^ (10g) 

which agrees with Eqs. (31) and (32) with I = Y = 0. 

Similarly, when the system is subjected to additive colored noise only 

^ = F(x)+ Vo (t), (109) 

the UCNA yields the effective Langevin equation given by 

dx ~ ~ 

— = F(x)+D Ut), (HO) 
16 



with 



D ° = (T^W (U2) 

The stationary distribution is given by 

p(x) oc exp[Z(x)], (113) 

with 

Z(x) = ~p° F ' ^J J F(x) dx. (114) 

When a system is subjected to multiplicative colored noise only, as given by Eq. (102), 
we may employ the method of a change of variable, with which it is transformed to that 
subjected to additive noise [23] : 

d j- t = F(y)+ m (t), (115) 

where 

» = Sw) sK{x) - (116) 

F(y) = (117) 

We get the effective Langevin equation given by Eq. (103) with 

F c = F(x), (118) 
~c D i 

Dl = [l-niF'-FG'/G)]- (119) 
In the case of F(x) = —Ax and Gi(x) = x, we get the distribution of p(x) given by 

p(x) oc x -[A(i+An)/Di+i] ; ( 120 ) 

which agrees with Eqs. (108). 

Table 1 summarizes a comparison among various approximate methods. It is noted 
that although the effective Langevin equation is rather different depending on the meth- 
ods, the stationary distribution given by Eq. (108) or (120) agrees each other in the linear 
Langevin model for which the ratio of F(x)/Di(x) is the same [Eq. (107)]. Difference 
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among the methods may be, however, realized in dynamical properties. Figure 8(a) and 
8(b) show responses of fj,(t) and j(t), respectively, to an applied pulse input given by Eq. 
(35), calculated by the FIM (solid curves), DS (dashed curves) and the UCNA (chain 
curves) with A = 1.0, D 1 = 0.2 and n = 1.0. We note that /x(t) and j(t) at 100 < t < 200 
calculated by the FIM is in good agreement with those of DS. Those of the UCNA are, 
however, much larger than those of DS. This is easily understood by Eqs. (36), (37), (104) 
and (105), from which we get (for D -C Di) 

- |A -LXm)] ' (forFIM) (121) 

fi u (t) ~ (1 + An) (Jt F (t), (for UCNA) (122) 

7 {t) ~ [X-2D 1 /(l + Xr 1 )][X-D l /(l + Xr 1 )r ( > ( ] 

7 U (t) ~ (1 + Ar!) 2 7 F (t). (for UCNA) (124) 

Similar results are obtained also for sinusoidal inputs: responses of fi(t) and j(t) to a 
sinusoidal input given by Eq. (38) are shown in Figs. 8(c) and 8(d), respectively. We 
note that their magnitudes calculated by the UCNA are again much larger than those of 
DS and the FIM. 

It has been claimed that the UCNA is justified by the FIM jgj EJ [10]. Although the 
FIM starts from the formally exact expression for the probability distribution, an actual 
evaluation has to adopt some kinds of approximations such as x = and (x) n = for 
n > 2 just as in the UCNA [21 E]. The result of Ref. EJ [TO] obtained by the FIM is 
different from that of Ref. [7J [Til 12] derived by the alternative FIM: the final result using 
the FIM depends on the adopted approximations. 



5 Conclusion 

We have extended the FIM approach such that we may discuss dynamics of the Langevin 
model subjected to additive and/or multiplicative colored noises, combined with equa- 
tions of motion for mean and variance of a state variable x. The stationary probability 
distribution and the dynamical response to time-dependent inputs have been discussed 
for two cases of colored noise: (a) one additive and one multiplicative colored noise, and 
(b) one additive and two multiplicative colored noise. Our conclusions are summarized 
as follows: 

(i) calculated results for the both cases (a) and (b) of the FIM are in good agreement with 
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those of DS for not only stationary but also dynamical properties: the latter can not be 
well accounted for by the existing, approximate analytical methods like the UCNA [6], 

(ii) with increasing the relaxation time of colored noise, the width of the stationary distri- 
bution p(x) becomes narrower and its non-Gaussian form approaches the Gaussian because 
the effective noise strength of D m becomes smaller than the original noise strength of D m , 
and 

(iii) the approximations given by Eqs. (27) and (59) for the cases (a) and (b), respectively, 
derived by the FIM are valid for both small and large relaxation times, which supports 
the result of RD2 and RD3 PS EE]. 

The item (i) implies that the present FIM approach may be applicable to a wide class 
of realistic models for physical systems subjected to noise sources with finite correlation 
time. Recently we have proposed a generalized Langevin-type rate-code neuronal model 
including multiplicative white noise [2UI25]- ^ would be interesting to study effects of 
finite correlation time of colored noise on firing rates in neuronal ensembles based on the 
rate-code hypothesis, which is an alternative to the temporary-code hypothesis [26], [27] . 
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Appendix: Derivation of the effective Fokker-Planck equation 

By applying the functional-integral method to the Langevin model given by 

dx 



(j/ F{x)+^2G m {x)r lm (t), (Al) 



with 



%w = _^„ m+ v^ ut) , (A2) 

at T m T m 

(&»(*)£n(0> = SmJ(t-t'), (A3) 

we may obtain the expression for the probability distribution: p(x, t) = (5(x(t) — x)) given 

by mm 

— p(x,t) = -—F(x)p(x,t)-J2-Q^Gm(x)(v m (t)S(x{t)-x)), (A4) 
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where the bracket (•) denotes the average over p(x,t). Although Eq. (A4) is a formally 
exact expression, it is evitable to employ some approximations to perform actual calcu- 
lations. In order to evaluate the average (r] m (t)8(x(t) — x)), we use the Novikov theorem 



n \ SVn 



(A5) 



where $(?7i, denotes a function of 771 and r] 2 , and c mn is their correlation function given 
by Eq. (5). From Eqs. (5) and (A5), we get 



(r)m{t)5(x{t) - x)) 



1 6(5(x(t)-x)) Sx 



IT I dt ' c mm(t, t') (S(x(t) -X) . 
OX Jo \ $Vm{t') 



After integrating Eq. (1), we get 

x(t) = x(0) + f* ds [F(x(s)) + J2 G m (x(s))r] m ( S )}. 

The functional derivative of x(t) of Eq. (A8) with respect to r) m (t') becomes 
6x(t) 



5r)m(t') 



G m (x(t'))+J* ds [F\x(s)) + ^G'Ms)) Vm (s)}-^- 



The derivative of Eq. (A9) with respect to t is given by 



d_ 

dt 



5x(t) 
5rj m (t') 



[F'(x(t)) + ^G' n (x(t))Vn(t)) 



Sx(t) 
6rj m (t') 



The formal solution of Eq. (A10) with the initial condition: 

" 6x(t) 



0_ 

Of 



5r) m (t') 



G m (x(t')), 



is given by 



Sx(t) 
6rj m (t') 



G m (x(t'))exp 



ds [F'(x( S )) + Y,G' n (x(s))ri n (x(s))} 



The derivative of G m (x(t)) with respect to t becomes 
jG m {x{t)) = G' m (x(t))^ 



G' m (x(t))[F(x(t))+J2G n (x(t)) Vn (t)}. 

n 
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(A6) 
(A7) 



(A8) 



(A9) 



(A10) 



(All) 



(A12) 



(A13) 
(A14) 



The integral of Eq. (A14) yields 



G m (x(t')) = G m (x(t))exp 



t dS ( 



G'Jx{s)) ' 
G m (x(s)) 



[F(x(s))+j:G n (x(s))rj n (x(s))} 



Substituting Eqs. (A12) and (A15) to Eq. (A9), we get 

6x(t) t rt 



SVm(t') 



G m (x(t)) exp (J ds 



f '^-gW) F{x{s)) 



(A15) 



(A16) 



where contributions from terms including rj n in Eq.(Al2) and (A15) are neglected. Com- 
bining Eq. (A7) with Eq. (A16), we get 

d 



( Vm (t)5(x(t) - x)) = -—G m (x(t)) jf dt' 



x 



S(x(t) — x) exp / ds 



/ G'(x(s)) , s ' 



G m (x(s))' 



By using the decoupling approximation given by 
(^5(x(t) — x) exp i^J ds 

~ (5(x(t) — x)) exp 



G m (x(s))' 



(t - o 



(A17) 

(A18) 
(A19) 

(A20) 

[l-r m {(F')-(FG'jG m ))Y (A21) 
where F' = dF/dx and G' m = dG m /dx, and the bracket (•) expresses the average over 
p(x,t). Substituting Eq. (A20) to Eq. (A4), we finally get the effective FPE given by 

-p(x,t) = -—F(x)p(x,t) + ^D m -^G m (x)—G m (x) P (x,t), (A22) 



we get 



with 



- Wi) F{x{t)) 



d 



(r] m (t)5(x(t) - x)) ~ D m —G m (x)p(x,t), 



D r 



from which we get the effective Langevin equation given by 



with 



dx l — ~ — 

— = F{x)+Y i N2D m G m {x)U{t), 
dt „ 



(U(t)) = o, 
(U(t)Ut')} = S mn 5(t-t'). 



(A23) 

(A24) 
(A25) 
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Table 1 A comparison among various methods yielding the effective equation given by 
x = F(x) + y2Ajfo(t) + \f2£hG{x)ii{t) for the Langevin model: x = F(x) + r] {t) + 
G(x)rji(t) subjected to colored noise r\ m with the relaxation time r m (m = 0, 1) given by 
Eqs. (1) and (2); the bracket (•) denotes the average over p(x,t): F s = F(x s ), F' s = F'(x s ) 
etc. for the stationary x s (see text). 



F 


Do 




method 


F 


D /(1-t (F')) 


Di/[l - 


n((F') 


- (FG'/G))} 


FIM a) 


F 


D /(l - r F s ') 


Di/[1 ~ 


-ri(K- 


- FsG'JGs)] 


FIM 6) 


F 




Dx/[l 


-n(F' 


- FG'/G)} 


CV C) 


F/il-niF'-FG'/G)} 




Dx/[l 


-n{F'- 


- FG'/G)] 2 


UCNA d) 


F/(l - tqF') 


D /(l - TqF') 2 








UCNA e) 


F/(l - TqF') 


Dq/(1 - TqF') 2 








FIM /} 


F 


D /(1-t (F')) 








MM 9) 



(a) the functional-integral method (FIM; present study). 

(b) FIM (Ref. [mug). 

(c) a change of variable (CV) for multiplicative colored noise only (after Ref. [23]). 

(d) UCNA calculation for multiplicative colored noise only (Ref. |6j). 

(e) UCNA calculation for additive colored noise only (Ref. [6]). 

(f) FIM for additive colored noise only (Ref. [TO]). 

(g) moment method (MM) for additive colored noise only (Ref. [5]). 
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Figure 1: The ratio of D\jD\ vs. T\ calculated by the FIM (solid curve), the approxi- 
mation (APP) given by Eq. (27) (dashed curve) and the difference of (FIM- APP) x 10 
(chain curve) with / = 0.5, A = 1.0, D = 0.01, D 1 = 0.2 and r = 0.01. 



Figure 2: (Color online) The stationary distributions p(x) for T\ = 0.1 [(a), (b) ], T\ — 1.0 
[(c), (d) ] and T\ = 5.0 [(e), (f)] calculated by the FIM (solid curves), DS (dashed curves), 
the approximation given by Eq. (27) (APP; chain curves) and in the white-noise limit 
(WN; double chain curves) with / = 0.5, A = 1.0, D Q = 0.01, D 1 = 0.2 and r = 0.01: 
(a), (c) and (e) are in normal scale, and (b), (d) and (f) are in log scale. 



Figure 3: (Color online) The response of ji{t) and ^(t) to pulse input for T\ — 0.1 [(a), 
(b) ], n = 1.0 [(c), (d) ] and t x = 5.0 [(e), (f)] calculated by the FIM (solid curves), DS 
(dashed curves), the approximation (APP) given by Eq. (27) (chain curves) and in the 
white-noise limit (double chain curves) with A = 1.0, D = 0.01, D\ = 0.2 and t = 0.01: 
fi(t) is plotted in (a), (c) and (f), ^(t) in (b), (d) and (f), and a pulse input I(t) given 
by Eq. (35) is shown at bottoms of (a), (c) and (e). The ordinate of (f) is different from 
those of (b) and (d): y{t) in the white-noise limit (double-chain curve) is multiplied by a 
factor of 1/5. 



Figure 4: (Color online) The response of fj,(t) and y{t) to sinusoidal input for T\ — 0.1 
[(a), (b) ], Ti = 1.0 [(c), (d) ] and n = 5.0 [(e), (f)] calculated by the FIM (solid curves), 
DS (dashed curves), the approximation given by Eq. (27) (chain curves) and in the white- 
noise limit (double chain curves) with A = 1.0, Dq = 0.01, D\ = 0.2 and tq = 0.01: fi(t) 
is plotted in (a), (c) and (f), y(t) in (b), (d) and (f), and a sinusoidal input I(t) given 
by Eq. (38) is shown at bottoms of (a), (c) and (e). The ordinate of (f) is different from 
those of (b) and (d): y(t) in the white-noise limit (double-chain curve) is multiplied by a 
factor of 1/5. 



Figure 5: (Color online) The ratio of D m /D m vs. T\ (= T2/IO) (m = 1,2) calculated by 
the FIM (m = 1, solid curve; m = 2, dashed curve) and the difference of (FIM- APP)x 
50 (m = 1, chain curve; m = 2, double-chain curve) with A = 1.0, D = 0.01, D\ = 0.1, 
D 2 = 0.2 and r = 0.01, results of the APP being given by D^ pp in Eq. (59). 
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Figure 6: (Color online) The stationary distributions p(x) for T\ = 0.05, r 2 = 0.5 [(a), 
(b) ], n = 0.5, r 2 = 5.0 [(c), (d) ] and n = 5.0, r 2 = 50.0 [(e), (f)] calculated by the FIM 
(solid curves), DS (dashed curves), the approximation given by Eq. (59) (chain curves) 
and in the white-noise limit (double chain curves) with / = 0.5, A = 1.0, D = 0.01, 
Dx — 0.1, D 2 — 0.2 and r = 0.01: (a), (c) and (e) are in normal scale, and (b), (d) and 
(f) are in log scale. 



Figure 7: (Color online) The response of /i(t) and j(t) to pulse input for t\ = 0.05, 
r 2 = 0.5 [(a), (b) ], n = 0.1, r 2 = 1.0 [(c), (d) ] and n = 0.5, r 2 = 5.0 [(e), (f)] calculated 
by the FIM (solid curves), DS (dashed curves), the approximation given by Eq. (59) 
(chain curves) and in the white-noise limit (double chain curves) with A = 1.0, D = 0.01, 
£>i = 0.1, D 2 = 0.2 and r = 0.01: fi(t) is plotted in (a), (c) and (f), 7(f) in (b), (d) 
and (f), and an input pulse I(t) given by Eq. (35) is shown at bottoms of (a), (c) and 
(e). The ordinate of (f) is different from those of (b and (d): 7(2) in the white- noise limit 
(double-chain curve) is multiplied by a factor of 1/5. 



Figure 8: (Color online) Time courses of fi(t) (a) and 7 (b) for a pulse input and those 
of n(t) (c) and 7 (d) for a sinusoidal input, calculated by the FIM (solid curves), DS 
(dashed curves) and the UCNA (chain curves) for A = 1.0, D± = 0.2 and T\ = 1.0: pulse 
and sinusoidal inputs I(t) given by Eqs. (35) and (38), respectively, are shown at the 
bottoms of (a) and (c). 
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